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(54) Multi-media communication system and method therefor 



(57) A multi-media communication system has a da- 
ta transmitter and communication terminals. Each com- 
munication terminal has a communication interface for 
communicating with the data transmitter via control sig- 



nals, and a buffer for storing multi-media data. The con- 
trol signals include a request for stopping data transmis- 
sion, a request for restarting data transmission, and a 
request for transmission of a predetermined amount of 
data. 



Fig.1. 
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Description 

The present invention relates to a multi-media com- 
munication system, and more particularly to a multi-me- 
dia communication system having a data transmitter 5 
and a communication terminal. 

There are many known multi-media communication 
systems. For one exemplary multi-media communica- 
tion system, television services called VOD (Video-On- 
Demand) using communication lines such as cable tel- io 
evision (CATV) lines have been developed. Such a con- 
ventional multi-media communication system has a 
head end unit and control terminal units. Each control 
terminal unit has a display unit connected thereto. The 
control terminal unit, typically disposed in an individual is 
subscriber's home or office system, sends a control sig- 
nal requesting a desired program to the head end unit 
(typically a data transmitter housed in or under the con- 
trol of a remote broadcast program source). The control 
signal is sent in response to operation by the subscriber. 20 

In response to the control signal, the head end unit 
sends the requested program to a predetermined chan- 
nel in th8 form of multi-media data, and sends a channel 
information to the control terminal unit. The control ter- 
minal unit selectively receives the program on the chan- 25 
nel specified by the channel information, and outputs the 
program to the subscriber's display unit. Thus, the sub- 
scriber can access (e.g., view) the desired program. 

The conventional multi-media communication sys- 
tem stores in a separate recording medium an output 30 
mode control code for a special effect (e.g., slow-motion 
play) in addition to picture data and sound data. 

This conventional multi-media communication sys- 
tem has a problem such that, since the special effect for 
the multi-media data on the control terminal units re- 35 
quires that the control code for special effects be sepa- 
rately stored in a recording medium, a medium capacity 
must be sufficient (e.g., large enough) for storing the 
control code. Moreover, the head end unit must have a 
controller for sending data while mutually synchronizing fo 
the data according to a request signal from the control 
terminal unit. As a result, the size of the head end unit 
is unnecessarily large. 

In view of the foregoing problems of the convention- 
al system, a feature of a multi-media communication 45 
system to be described below, by way of example, in 
illustration of the invention, is that it enables various spe- 
cial affects to be performed, without increasing the size 
of a data transmitter. 

In a particular multi-media communication system so 
to be described below, by way of example, in illustration 
of an aspect of the present invention, a data transmitter 
provides multi-media data. A communication terminal 
utilizes the multi-media data with a special effect. The 
communication terminal requests a next multi-media ss 
data from the data transmitter according to an amount 
of multi-media data utilized with the special effect. 

With the unique and unobvious structure of the 



2 

present invention, a multi-media communication system 
is enabled to provide various special effects, without in- 
creasing the data transmitter size. 

The following description and drawings disclose, by 
means of an example, the invention which is character- 
ised in the appendedclaims, whose terms determine the 
extent of the protection conferred hereby. 

In the drawings:- 

FIG. 1 is a block schematic diagram showing the 
configuration of a multi-media communication sys- 
tem, 

FIG. 2 is a block schematic diagram showing the 
configuration of the communication terminal 200 
used in the multi-media communication system of 
Fig. 1. 

FIG. 3 is a block schematic diagram showing the 
configuration of the data transmitter 1 00 used in the 
multi-media communication system of Fig. 1 , 
FIG. 4 is a diagrammatic illustration of the configu- 
' ration of one segment of multi-media data sent by 
the data transmitter 100, 

F!G. 5 is a flowchart showing the normal operation 

in the communication terminal 200, 

FIG. 6 is a flowchart showing an exemplary special 

effect (e.g., a slow-motion replay operation) in the 

communication terminal 200, and 

FIG. 7 is a flowchart showing the operation of the 

data transmitter 100. 

Referring to FIG. 1, a multi-media communication 
system has a data transmitter 1 00 and at least one com- 
munication terminal 200, and more typically, a plurality 
of communication terminals 200, for communicating 
with the data transmitter 100. The data transmitter 100 
stores multi-media data, and sends the multi-media data 
to the communication terminals 200 at the request of the 
subscriber associated with the respective communica- 
tion terminal 200. Each communication terminal 200 re- 
ceives the mufti-media data, and displays video and/or 
sound data accordingly. 

Referring to FIG. 2, each of the communication ter- 
minals 200 has an input device 21 0, a terminal controller 
220, a communication interface 230, a tuner 240, a sig- 
nal separator 250, an image processor 260 including an 
image buffer and an image decoder 262, a sound proc- 
essor 270 including a sound buffer 271 and a sound de- 
coder 272, a display 280, and an audio output device 
(speaker) 290. The terminal controller 220, the commu- 
nication interface 230, the tuner 240, the signal separa- 
tor 250, the image processor 260, and the sound proc- 
essor 270 are coupled together by a control bus 201. 

The input device 210 (e.g., keyboard, infrared re- 
mote controller, touch screen/pad, joy-stick, track ball, 
voice input, or the like) is used to input instructions from 
a user (subscriber). The terminal controller 220 receives 
the instructions from the input device 210, and controls 
the multi-media communication system via the control 
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bus 201 . 

The tuner 240 receives multi-media data 401, which 
may include image and/or sound data, from the data 
transmitter 100, and selects a predetermined channel 
of the multi-media data 401: The signal separator 250 £ 
separates image data and sound data from the multi- 
media data 401. The image data are sent to the image 
processor 260. The sound data are sent to the sound 
processor 270, 

The image processor 260 includes the image buffer 10 
261 and the image decoder 262. The image buffer 261 
stores the image data from the signal separator 250. 
The image decoder 262 decodes the image data stored 
in the image buffer 261 . 

The sound processor 270 includes the sound bufler ^5 
271 and the sound decoder 272. The sound buffer 271 
stores the sound data from the signal separator 250. 
The sound decoder 272 decodes the sound data stored 
in the sound buffer 271. 

The display 2B0 displays the image data decoded 20 
by the image decoder 262. The speaker 290 amplifies 
(typically using a variable gain) and outputs the sound 
data decoded by the sound decoder 272 in a synchro- 
nous manner with the image data with synchronization 
circuitry known in the art. 25 

The communication interface 230 communicates 
with the data transmitter 100 via a control signal 402. 
The control signal 402 includes a request lor stopping 
data transmission, a request for restarting data trans- 
mission, and a request for transmission o< a predeter- so 
mined amount of data. 

Referring to FIG. 3, the data transmitter 100 has a 
data storage 110, a server 120, a server memory 130, 
a data controller 140, and a controller memory 150. 

The data storage 1 1 0 stores multi-media data. The 35 
data storage 110 includes a high-capacity auxiliary stor- 
age (e.g., an optical disk unit or a magnetic tape for hold- 
ing video arid/or audio data). The server 120 reads out 
muiti-media data from the data storage 110, and holds 
the read multi-media data in the server memory 1 30 so 40 
that a predetermined amount of multi-media data is held 
in the server memory 1 30 to supply the multi-media data 
for the communication terminal 200 without interruption. 

The data controller 140 reads out multi-media data 
from the server 120, and sends out the multi-media data f5 
to the communication terminal 200 via the signai line 
401. 

Referring to FIG. 4, the mufti-media data stored in 
the data storage 110 is formed from a plurality of seg- 
ments 500. Each segment has at least one Group-Of- so 
Pictures (GOP). In this case, the segment 500 has two 
GOPs 510 and 520. One GOP 510 has a header field 
511 and a data field 512. The data controller 1 40 recog- 
nizes the header fields as boundaries of video and/or 
audio data. 55 

For example, if one segment 500 is assumed to 
have 30 pictures, each of data fields 512 and 522 in- 
cludes 1 5 pictures. Hence, each of the data fields is as- 



476 A2 4 

sumed to have a number of pictures equal to the other. 
Thus, if 30 frames are displayed per second during nor- 
mal playback, then data for one second is stored in one 
segment and data for 0.5 seconds is stored in each 
GOP. The multi-media data is sent from the data con- 
troller 140 according to this display speed. 

Hereinbelow and referring to FIGs. 2, 3, 5, 6, and 
7, the operation of the multi-media communication sys- 
tem in accordance with the above-mentioned embodi- 
ment of the present invention will be described. 

Referring to FIG. 5, the communication terminal 200 
receives muiti-media data from the data transmitter 1 00 
via the signal line 401 (step S501 ). The tuner 240 selects 
the predetermined channel of the multi-media data on 
signal line 401 (step S502). The signal separator 250 
separates image data and sound data from the multi- 
media data on signal line 401 (step S503). 

If the separated data is image data (step S504), 
then the separated data is stored in the image buffer 
261 (step S505). If the separated data is sound data 
(step S504), then the separated data is stored in the 
sound buffer 25 1 (step S50S). The image data in the 
image buffer 261 is decoded by the image decoder 262 
(step S506), and is disptayed by the display 280 (step 
S507). The sound data in the sound buffer 271 is de- 
coded by the sound decoder 272 (step S509), and is 
amplified and output by the speaker 290 (step S510). 
As mentioned above, image and sound reproduction are 
performed in a synchronous manner with known circuit- 
ry 

If a request for a special effect (e.g., a slow-motion 
play) is inputted from the input device 210 (step S511), 
then the communication terminal operates in a slow-mo- 
tion play mode as illustrated in the flowchart in FIG. 6 
(step S512). Otherwise, operations from step S501 are 
repeated for the remaining multi-media data in the pro- 
gram or broadcast. 

Referring to FIG. 6 and the special effect mode (e. 
g., slow-motion play mode) operation, the terminal con- 
troller 220 sends a request lor stopping data transmis- 
sion to the communication interface 230 via the control 
bus 201 . In response to the request, the communication 
interface 230 sends the control signal 402, indicating the 
request for stopping the data transmission, to the data 
transmitter 100 (step S601 ). This request to stop the da- 
ta transmission is received by the data transmitter 100, 
and the output of the multi-media data via the signal line 
401 is temporarily stopped according to a process de- 
scribed below. 

Specifically, the terminal controller 220 sends a re- 
quest for slow-motion play to the image decoder 262 via 
the control bus 201. In response to the request, slow- 
motion play is performed by the image decoder 262 
based on the picture data held in the image buffer 261 . 
In this case, the slow-motion play is carried out by re- 
petitively playing (e.g., outputting) tne same frame (pic- 
ture) "N" (where N is an integer greater than 1) times 
(step 602). 
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For example, by repetitively playing the same frame 
(picture) twice (e.g.. N=2), slow-motion play can be per- 
formed at 1/2 of the normal playback speed (e.g., 15 
frames per second if the normal playback speed is as- 
sumed to be 30 frames per second), and by repetitively 
playing the same frame (picture) three times (e.g., N=3), 
slow-motion play can be performed at 1/3 of the normal 
playback speed (e.g., 10 frames per second if the nor- 
mal playback speed is assumed to be 30 frames per 
second). 

The image buffer 261 continually checks the 
amount of the data remaining in the image buffer 261 
(stepS603) . If the remainingdata is undarthe reference 
value (e.g., (capacity of the image buffer 261) - (1 
GOP)), then the image buffer 261 outputs a signal to the 
communication interface 230 which in turn sends a re- 
quest for transmission of a predetermined amount of 
multi-media data to the data transmitter 1 00 via the con- 
trol signal line 402 (step S605). 

The predetermined amount corresponds to the ca- 
pacity of the image buffer 261 for holding data which 
was newly received in response to the request. 

The terminal controller 220 checks whether the in- 
put device 21 0 has inputted a request for restarting the 
data transmission by a user (step S606) . if the input 
device 210 has not inputted the request for restarting 
the data transmission, then operations from the step 
S602 are repeated (step S607). 

If the input device 210 has inputted the request for 
restarting the data transmission, then the communica- 
tion interface 230 sends a request for restarting the data 
transmission to the data transmitter 1 00 via the signal 
line 402 (step S60S). 

Thereafter, the slow-motion play mode is reset (e. 
g., terminated) the output of the multi-media data via the 
signal line 401 at the normal playback speed (e.g., 30 
frames per second) is resumed by the data transmitter 
100 (step S609). 

Next, the operation of the data transmitter 100 is 
described. 

In the normal playback operation, the data control- 
ler 140 receives multi-media data from the server 120 
on a segment basis according to the normal playback 
speed on the multi-media communication terminal 200 
and holds the mufti-media data in the controller memory 
1 50, and sends the multi-media data via the signal line 
401. 

If the data transmitter 100 receives from communi- 
cation interface 230 the request for stopping the data 
transmission via the control signal line 402, the output 
of the multi-media data via the signal line 401 is stopped 
immediately afterthe completion of the unfinished trans- 
mission of the GOP. 

If the data transmitter 100 receives the request for 
data transmission of a predetermined amount via the 
control signal line 402, the special playback operations 
in FIG. 7 are started. 

Referring to FIG. 7, it is determined whether the pre- 
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ceding transmitted data is a GOP positioned in the sec- 
ond half of a segment (e.g., end of a segment) (step 
S701). If the preceding transmitted data is the second 
half GOP, then the data controller 140 divides the seg- 
s ment stored in the controller memory 150 in half accord- 
ing to the header field to produce first and second half- 
segments (slep S702). Thus, each half-segment in- 
cludes a headerfield and a data field. The data controller 
140 sends the first half -segment to the communication 
terminal 200 via the signal line 401 (step S703). The da- 
ta controller 140 stores the second half-segment in the 
controller memory 150 (step S704). 

On the other hand, in step S701, if the preceding 
transmitted data is the first GOP, then the GOP held in 
the controller memory 150 is read-out and sent to the 
communication terminal 200 (step S705). The data con- 
troller 1 40 receives one segment from the server 1 20 as 
the next data and stores it in the controller memory 1 50 
(step S706). 

Further, if the control signal on signal line 402 from 
the communication terminal 200 indicates a request for 
starting the normal transmission, the process returns to 
the above-described operation for the normal playback. 

Although an example has been described in which 
the image buffer 261 and the sound buffer 271 in the 
communication terminal 200 have a storage capacity for 
holding mufti-media data for one to two GOPs, the 
present invention is not limited to this configuration. 

For example, it may be configured such that, in re- 
sponse to a request for sending a predetermined 
amount of data from the communication terminal 200, a 
plurality of GOPs are sent from the data controller 140 
corresponding to the amount of data that can be held in 
the image buffer 261 in the communication terminal 200. 

The above description of an embodiment illustrative 
of the invention shows that, since the communication 
interface 230 requests the control of the data transmis- 
sion from the data transmission 100, no medium (or its 
size and capacity) for storing control codes for special 
effects is required. Thus, ft is not necessary for there to 
be an increase in the size of the data transmitter. 

Although slow-motion playback has been described 
above, this special effect is but one exemplary special 
effect, and the protection sought is not limited to this 
specific special effect. Indeed, the present invention can 
be equally applied to any special effects presently 
known in the industry. For example, by making the play- 
back speed slower, a frame advance play or pause may 
be performed, and by reversing the playback sequence 
of image data, a reverse play or reverse slow-motion 
play may be performed. Likewise, fast-motion advance 
play or reverse play may be performed. Further, by using 
the image data within the image buffer 261 to perform a 
playback with a timing or sequence different from the 
normal playback, various special effects are possible. 

In addition, simiiar special effects for playback can 
be performed for not only image data but also for sound 
data. 
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It will be understood that, although a particular em- 
bodiment illustrative of the invention has been described 
by way of example, variations and modifications thereof, 
as well as other embodiments may be made within the 
scope of the protection sought by the appended claims. 



comprising:' 

a tuner for selecting a predetermined channel 
of the multi-media data for said multi-media data 
processor. 



lulti-media c 



system, comprising: 



i system according 
lulti-media data processor com- 



a data transmitter for providing a multi-media 
data; and 

a communication terminal for selectively utiliz- 
ing the multi-media data with a special effect, 
wherein said communication terminal requests 
a next multi-madia data from said data trans- 
mitter according to an amount of the multi-me- 
dia data with the special effect having been uti- 
lized. 

The multi-media communication system according 
to claim 1 , said communication terminal comprising: 

a multi-media data processor for storing and 
decoding the multi-media data; and 
a communication interface for requesting the 
next multi-media data from said data transmit- 



The multi-media 
to claim 2, said 
prising: 



a multi-media data buffer for storing the multi- 
media data; and 

a multi-media data decoder for decoding the 
multi-media data stored in said multi-media da- 
ta buffer. 

The multi-media communication system according 
to claim 3, wherein said multi-media data buffer in- 
forms said communication interface of an amount 
of the multi-media data remaining in said multi-me- 
dia data buffer to be utilized, and 

wherein said communication interface re- 
quests the next multi-media data from said data 
transmitter according to the amount of the image 
data remaining in said multi-media data buffer. 



The multi-media communication system according ' 
to claim 4, said communication terminal further 
comprising: 

an input device for inputting to said multi-me- 
dia data processor a request for the special effect. 

The multi-media communication system according 
to claim 4, said communication terminal further 



7. The multi-media communication system according 
to claim 2, said communication terminal further 
comprising: 

10 a signal separator for separating the multi-me- 

dia data into an image data and a sound data, 
and 

said multi-media data processor comprising: 

' 5 an image processor for processing the im- 

age data; and 

a sound processor for processing the 
sound data. 

20 • 8. The mutti-media communication system according 
to claim 7, said Image processor comprising: 

an image buffer for storing the image data; and 
an image decoder for decoding the image data 

25 stored in said image buffer, 

wherein said image buffer informs said commu- 
nication interface of an amount of the image da- 
ta remaining in the image buffer to be decoded, 
and wherein said communication interface re- 

30 quests the next multi-media data from said data 

transmitter according to the amount of the im- 
age data remaining in said image buffer. 

9. The multi-media communication system according 
35 to claim 7, said sound processor comprising: 

a sound buffer for storing the sound data; and 
a sound decoder for decoding the sound data 
stored in said sound buffer, 

'to wherein said sound buffer informs said commu- 

nication interface of an amount of the sound da- 
ta remaining in sid sound buffer to be decoded, 
and wherein said communication interface re- 
quests the next multi-media data from said data 

*5 transmitter according to the amount of the 

sound data remaining in said sound buffer. 

10. The multi-media communication system according 
to claim 1 , said data transmitter comprising: 

60 

a data storage for storing the multi-media data; 
and 

a data controller for sending the multi-media 
data to said communication terminal. 

ss 

11. The multi-media communication system according 
to claim 10, wherein the multi-media data includes 
at least one segment, said at least one segment 
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comprising at least one group of pictures, and 
wherein said data controller divides said at least 
one segment into first and second group-of-pictures 
portions. 

12. A communication terminal for utilizing a multi-media 
data with a special effect, comprising: 

a multi-media data processor for storing and 
decoding the multi-media data; and 
a communication interface for requesting a next 
mu Iti-media data according to an amount of the 
multi-madia data having been utilized with the 
special effect by said communication terminal. 

1 3. The communication terminal according to claim 1 2, 
said multi-media data processor comprising: 

a multi-media data buffer for storing the multi- 
media data; and 

a mufti-media data decoder for decoding the 
mutti-media data stored in said multi-media da- 
ta buffer. 

14. The communication terminal according to claim 1 3, 
wherein said mufti-media data buffer informs said 
communication interface of an amount of the multi- 
media data remaining in said multi-media buffer to 
be utilized, and wherein said communication inter- 
face requests the next multi-media data according 
to the amount of said multi-media data remaining in 
said multi-media data buffer. 

1 5. The communication terminal according to claim 1 4. 
further comprising: 

an input device for inputting a request for the 
special effect to said multi-media data proces- 
sor; and 

a tuner for selecting a predetermined channel 
of the mutti-media data for said multi-media da- 
ta processor. 

16. The communication terminal according to claim 1 2. 
further comprising: 

a signal separator for separating the multi-me- 
dia data into an image data and a sound data, 
and 

said multi-media data processor comprising: 

an image processor for processing the im- 
age data; and 

a sound processor for processing the 
sound data. 



a data storage for storing a mutti-media data; 
and 

a data controller for outputting the multi-media 
data, wherein the multi-media data includes at 
least one segment, said at least one segment 
including at least one group of pictures, and 
wherein said data controller divides said at 
least one segment into first and second group- 
of-pictures portions. 

18. A method for utilizing a multi-media data in a com- 
munication terminal having a buffer, said method 
comprising steps of: 

requesting termination of a transmission of the 
multi-media data; 

processing the multi-media data with a special 
effect; 

judging whether an amount of said multi-media 
data remaining in said buffer to be processed 
is less than a reference value; and 
based on said judging step, requesting trans- 
mission of a predetermined amount of a multi- 
media data, if the amount of said multi-media 
data remaining in said buffer to be processed 
is less than the reference value. 

19. The method for utilizing the multi-media data in the 
communication terminal according to claim 18, said 
processing step comprising a step of: 

playing a same picture of an image data in the 
multi-media data a plurality of times. 

20. A method for transmitting a multi-media data by a 
data transmitter, said method comprising steps of: 

dividing a segment of the multi-media data into 

a plurality of groups of pictures; 

outputting a first group of pictures; 

storing remaining ones of said groups of pic- 

outputting a second group of pictures of said 
remaining ones of said groups of pictures. 



17. A data transmitter, comprising: 
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Fig.1. 
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Fig.6. 

(slow play) 



DATA TRANSMISSION 
STOP REQUEST 



DISPLAY 
N TIMES 



CHECK 
REMAINING DATA 
IN BUFFER 




DATA TRANSMISSION 
REQUEST 



S606 



CHECK 
SLOW PLAY 
RESET REQUEST 

-S607 

' REQUEST ; 




DATA TRANSMISSION 
RESTART REQUEST 



RESET 
SLOW PLAY 



( END ) 



11 



11/12 



24-01-2009, 



Printed: 28-01-2009 



ODOCP 



EP 06 019 6C2 



EP 0 766 476 A2 



Fig.7. 
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